Stereo Matching with Reflections and Translucency
نویسندگان
چکیده
In this paper, we address the stereo matching problem in the presence of reflections and translucency, where image formation can be modeled as the additive superposition of layers at different depth. Thepresenceof sucheffects violates the Lambertian assumption underlying traditional stereo vision algorithms, making it impossible to recover component depths using direct color matching based methods. We develop several techniques to estimate both depths and colors of the component layers. Depth hypotheses are enumerated in pairs, one from each layer, in a nested plane sweep. For each pair of depth hypotheses, we compute a componentcolor-independent matching error per pixel, using a spatialtemporal-differencing technique. We then use graph cut optimization to solve for the depths of both layers. This is followed by an iterative color update algorithm whose convergence is proven in our paper. We show convincing results of depth and color estimates for both synthetic and real image sequences.
منابع مشابه
Optimizing Disparity Candidates Space in Dense Stereo Matching
In this paper, a new approach for optimizing disparity candidates space is proposed for the solution of dense stereo matching problem. The main objectives of this approachare the reduction of average number of disparity candidates per pixel with low computational cost and high assurance of retaining the correct answer. These can be realized due to the effective use of multiple radial windows, i...
متن کاملSurface Reconstruction of Water Waves using Thermographic Stereo Imaging
This paper presents a system for the surface reconstruction of water waves using shape-from-stereo techniques. Based on two infrared cameras operating in the 3 − 5 μm wavelength range, the system acquires thermographic image sequences of the water surface with high temporal resolution. Due to the optical properties of water, imaging in this region of the infrared spectrum is well suited for ste...
متن کاملMultibaseline Stereo in the Presence of Specular Reflections
We address the problem of accurate depth estimation using multibaseline stereo in the presence of specular reflections. Specular reflections can cause the intensity and color of corresponding points to change dramatically according to different viewpoints, thus producing severe matching errors for various stereo algorithms. In this paper, we propose a new method to deal with this problem by tre...
متن کاملKey characteristics of specular stereo.
Because specular reflection is view-dependent, shiny surfaces behave radically differently from matte, textured surfaces when viewed with two eyes. As a result, specular reflections pose substantial problems for binocular stereopsis. Here we use a combination of computer graphics and geometrical analysis to characterize the key respects in which specular stereo differs from standard stereo, to ...
متن کامل